Pandas Profiling Report

Dataset statistics

Number of variables	12
Number of observations	2969
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	301.5 KiB
Average record size in memory	104.0 B

Variable types

Numeric	12

Alerts

`gross_revenue` is highly overall correlated with `qtde_invoice` and 5 other fields	High correlation
`recency_days` is highly overall correlated with `qtde_invoice`	High correlation
`qtde_invoice` is highly overall correlated with `gross_revenue` and 2 other fields	High correlation
`qtde_items` is highly overall correlated with `gross_revenue` and 5 other fields	High correlation
`qtde_products` is highly overall correlated with `gross_revenue` and 3 other fields	High correlation
`avg_basket_size` is highly overall correlated with `gross_revenue` and 3 other fields	High correlation
`avg_unique_basket_size` is highly overall correlated with `qtde_products`	High correlation
`freq` is highly overall correlated with `avg_rec_days`	High correlation
`avg_ticket` is highly overall correlated with `gross_revenue` and 3 other fields	High correlation
`avg_rec_days` is highly overall correlated with `freq`	High correlation
`qtde_returns` is highly overall correlated with `gross_revenue` and 3 other fields	High correlation
`avg_basket_size` is highly skewed (γ1 = 44.67431359)	Skewed
`avg_ticket` is highly skewed (γ1 = 53.44421547)	Skewed
`qtde_returns` is highly skewed (γ1 = 52.70290171)	Skewed
`customer_id` has unique values	Unique
`recency_days` has 34 (1.1%) zeros	Zeros
`qtde_returns` has 1481 (49.9%) zeros	Zeros

Reproduction

Analysis started	2022-12-19 18:33:20.141687
Analysis finished	2022-12-19 18:33:51.919225
Duration	31.78 seconds
Software version	pandas-profiling vv3.5.0
Download configuration	config.json

customer_id
Real number (ℝ)

Distinct	2969
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15270.773

Minimum	12347
Maximum	18287
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	12347
5-th percentile	12619.4
Q1	13799
median	15221
Q3	16768
95-th percentile	17964.6
Maximum	18287
Range	5940
Interquartile range (IQR)	2969

Descriptive statistics

Standard deviation	1718.9903
Coefficient of variation (CV)	0.11256734
Kurtosis	-1.2060947
Mean	15270.773
Median Absolute Deviation (MAD)	1488
Skewness	0.031607859
Sum	45338925
Variance	2954927.6
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17850	1	< 0.1%
17588	1	< 0.1%
14905	1	< 0.1%
16103	1	< 0.1%
14626	1	< 0.1%
14868	1	< 0.1%
18246	1	< 0.1%
17115	1	< 0.1%
16611	1	< 0.1%
15912	1	< 0.1%
Other values (2959)	2959	99.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
12347	1	< 0.1%
12348	1	< 0.1%
12352	1	< 0.1%
12356	1	< 0.1%
12358	1	< 0.1%
12359	1	< 0.1%
12360	1	< 0.1%
12362	1	< 0.1%
12364	1	< 0.1%
12370	1	< 0.1%

Value	Count	Frequency (%)
18287	1	< 0.1%
18283	1	< 0.1%
18282	1	< 0.1%
18277	1	< 0.1%
18276	1	< 0.1%
18274	1	< 0.1%
18273	1	< 0.1%
18272	1	< 0.1%
18270	1	< 0.1%
18269	1	< 0.1%

gross_revenue
Real number (ℝ)

Distinct	2954
Distinct (%)	99.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2747.1004

Minimum	6.2
Maximum	279138.02
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	6.2
5-th percentile	229.77
Q1	570.96
median	1084.1
Q3	2308.06
95-th percentile	7219.68
Maximum	279138.02
Range	279131.82
Interquartile range (IQR)	1737.1

Descriptive statistics

Standard deviation	10560.058
Coefficient of variation (CV)	3.8440742
Kurtosis	355.5067
Mean	2747.1004
Median Absolute Deviation (MAD)	672.05
Skewness	16.802797
Sum	8156141.2
Variance	1.1151482 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
178.96	2	0.1%
533.33	2	0.1%
889.93	2	0.1%
2053.02	2	0.1%
745.06	2	0.1%
379.65	2	0.1%
2092.32	2	0.1%
731.9	2	0.1%
1353.74	2	0.1%
331	2	0.1%
Other values (2944)	2949	99.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
6.2	1	< 0.1%
13.3	1	< 0.1%
15	1	< 0.1%
36.56	1	< 0.1%
45	1	< 0.1%
52	1	< 0.1%
52.2	1	< 0.1%
52.2	1	< 0.1%
62.43	1	< 0.1%
68.84	1	< 0.1%

Value	Count	Frequency (%)
279138.02	1	< 0.1%
259657.3	1	< 0.1%
194550.79	1	< 0.1%
168472.5	1	< 0.1%
136263.72	1	< 0.1%
124564.53	1	< 0.1%
116725.63	1	< 0.1%
91062.38	1	< 0.1%
72882.09	1	< 0.1%
66653.56	1	< 0.1%

recency_days
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	272
Distinct (%)	9.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	64.288649

Minimum	0
Maximum	373
Zeros	34
Zeros (%)	1.1%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	11
median	31
Q3	81
95-th percentile	242
Maximum	373
Range	373
Interquartile range (IQR)	70

Descriptive statistics

Standard deviation	77.756171
Coefficient of variation (CV)	1.2094852
Kurtosis	2.7780386
Mean	64.288649
Median Absolute Deviation (MAD)	26
Skewness	1.7983969
Sum	190873
Variance	6046.0221
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	99	3.3%
4	87	2.9%
2	85	2.9%
3	85	2.9%
8	76	2.6%
10	67	2.3%
9	66	2.2%
7	66	2.2%
17	64	2.2%
22	55	1.9%
Other values (262)	2219	74.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	34	1.1%
1	99	3.3%
2	85	2.9%
3	85	2.9%
4	87	2.9%
5	43	1.4%
7	66	2.2%
8	76	2.6%
9	66	2.2%
10	67	2.3%

Value	Count	Frequency (%)
373	2	0.1%
372	4	0.1%
371	1	< 0.1%
368	1	< 0.1%
366	4	0.1%
365	2	0.1%
364	1	< 0.1%
360	1	< 0.1%
359	1	< 0.1%
358	4	0.1%

qtde_invoice
Real number (ℝ)

Distinct	57
Distinct (%)	1.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.7217918

Minimum	1
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	4
Q3	6
95-th percentile	17
Maximum	206
Range	205
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	8.847316
Coefficient of variation (CV)	1.5462492
Kurtosis	190.04523
Mean	5.7217918
Median Absolute Deviation (MAD)	2
Skewness	10.743151
Sum	16988
Variance	78.275
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2	786	26.5%
3	498	16.8%
4	393	13.2%
5	237	8.0%
1	190	6.4%
6	173	5.8%
7	138	4.6%
8	98	3.3%
9	70	2.4%
11	54	1.8%
Other values (47)	332	11.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	190	6.4%
2	786	26.5%
3	498	16.8%
4	393	13.2%
5	237	8.0%
6	173	5.8%
7	138	4.6%
8	98	3.3%
9	70	2.4%
10	54	1.8%

Value	Count	Frequency (%)
206	1	< 0.1%
198	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	0.1%
86	1	< 0.1%
72	1	< 0.1%
62	2	0.1%
60	1	< 0.1%
57	1	< 0.1%

qtde_items
Real number (ℝ)

Distinct	1670
Distinct (%)	56.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1606.4187

Minimum	1
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	101.4
Q1	296
median	639
Q3	1399
95-th percentile	4407.4
Maximum	196844
Range	196843
Interquartile range (IQR)	1103

Descriptive statistics

Standard deviation	5882.5587
Coefficient of variation (CV)	3.6619088
Kurtosis	467.23973
Mean	1606.4187
Median Absolute Deviation (MAD)	420
Skewness	17.879512
Sum	4769457
Variance	34604497
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
310	11	0.4%
150	9	0.3%
88	9	0.3%
246	8	0.3%
260	8	0.3%
288	8	0.3%
272	8	0.3%
84	8	0.3%
134	8	0.3%
394	7	0.2%
Other values (1660)	2885	97.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	1	< 0.1%
2	2	0.1%
12	2	0.1%
16	1	< 0.1%
17	1	< 0.1%
18	1	< 0.1%
19	1	< 0.1%
20	1	< 0.1%
23	1	< 0.1%
25	1	< 0.1%

Value	Count	Frequency (%)
196844	1	< 0.1%
80997	1	< 0.1%
79879	1	< 0.1%
77373	1	< 0.1%
69993	1	< 0.1%
64549	1	< 0.1%
64124	1	< 0.1%
62812	1	< 0.1%
58243	1	< 0.1%
57772	1	< 0.1%

qtde_products
Real number (ℝ)

Distinct	469
Distinct (%)	15.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	122.66319

Minimum	1
Maximum	7837
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	9
Q1	29
median	67
Q3	135
95-th percentile	382
Maximum	7837
Range	7836
Interquartile range (IQR)	106

Descriptive statistics

Standard deviation	269.2448
Coefficient of variation (CV)	2.1949927
Kurtosis	354.42387
Mean	122.66319
Median Absolute Deviation (MAD)	44
Skewness	15.678323
Sum	364187
Variance	72492.76
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
28	46	1.5%
20	38	1.3%
35	35	1.2%
15	33	1.1%
29	32	1.1%
19	32	1.1%
11	32	1.1%
26	31	1.0%
18	30	1.0%
27	30	1.0%
Other values (459)	2630	88.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	6	0.2%
2	14	0.5%
3	16	0.5%
4	17	0.6%
5	26	0.9%
6	29	1.0%
7	18	0.6%
8	19	0.6%
9	27	0.9%
10	27	0.9%

Value	Count	Frequency (%)
7837	1	< 0.1%
5586	1	< 0.1%
5095	1	< 0.1%
4577	1	< 0.1%
2698	1	< 0.1%
2379	1	< 0.1%
2060	1	< 0.1%
1818	1	< 0.1%
1673	1	< 0.1%
1636	1	< 0.1%

avg_basket_size
Real number (ℝ)

HIGH CORRELATION
SKEWED

Distinct	1974
Distinct (%)	66.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	249.39271

Minimum	1
Maximum	40498.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	44
Q1	103.25
median	172
Q3	281.5
95-th percentile	599.52
Maximum	40498.5
Range	40497.5
Interquartile range (IQR)	178.25

Descriptive statistics

Standard deviation	791.55574
Coefficient of variation (CV)	3.173933
Kurtosis	2255.6274
Mean	249.39271
Median Absolute Deviation (MAD)	82.75
Skewness	44.674314
Sum	740446.95
Variance	626560.48
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	11	0.4%
114	10	0.3%
73	9	0.3%
82	9	0.3%
86	9	0.3%
60	8	0.3%
140	8	0.3%
75	8	0.3%
88	8	0.3%
163	8	0.3%
Other values (1964)	2881	97.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	2	0.1%
2	1	< 0.1%
3.333333333	1	< 0.1%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%
6.142857143	1	< 0.1%
7.5	1	< 0.1%
9	1	< 0.1%
9.5	1	< 0.1%
11	1	< 0.1%

Value	Count	Frequency (%)
40498.5	1	< 0.1%
6009.333333	1	< 0.1%
4282	1	< 0.1%
3906	1	< 0.1%
3868.65	1	< 0.1%
2880	1	< 0.1%
2801	1	< 0.1%
2733.944444	1	< 0.1%
2518.769231	1	< 0.1%
2160.333333	1	< 0.1%

avg_unique_basket_size
Real number (ℝ)

Distinct	1009
Distinct (%)	34.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	22.15117

Minimum	1
Maximum	299.70588
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	3.3454545
Q1	10
median	17.2
Q3	27.75
95-th percentile	56.94
Maximum	299.70588
Range	298.70588
Interquartile range (IQR)	17.75

Descriptive statistics

Standard deviation	19.512963
Coefficient of variation (CV)	0.88089984
Kurtosis	27.697928
Mean	22.15117
Median Absolute Deviation (MAD)	8.2
Skewness	3.4988031
Sum	65766.825
Variance	380.75571
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
13	54	1.8%
14	40	1.3%
11	38	1.3%
9	33	1.1%
18	33	1.1%
1	32	1.1%
20	31	1.0%
10	30	1.0%
16	29	1.0%
17	28	0.9%
Other values (999)	2621	88.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	32	1.1%
1.2	1	< 0.1%
1.25	1	< 0.1%
1.333333333	2	0.1%
1.5	8	0.3%
1.568181818	1	< 0.1%
1.571428571	1	< 0.1%
1.666666667	4	0.1%
1.833333333	1	< 0.1%
2	24	0.8%

Value	Count	Frequency (%)
299.7058824	1	< 0.1%
259	1	< 0.1%
203.5	1	< 0.1%
148	1	< 0.1%
145	1	< 0.1%
136.125	1	< 0.1%
135.5	1	< 0.1%
127	1	< 0.1%
122	1	< 0.1%
118	1	< 0.1%

freq
Real number (ℝ)

Distinct	1349
Distinct (%)	45.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.063268815

Minimum	0.0054495913
Maximum	3
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	0.0054495913
5-th percentile	0.0094339623
Q1	0.017777778
median	0.029411765
Q3	0.055401662
95-th percentile	0.22222222
Maximum	3
Range	2.9945504
Interquartile range (IQR)	0.037623884

Descriptive statistics

Standard deviation	0.13447745
Coefficient of variation (CV)	2.1254933
Kurtosis	121.57483
Mean	0.063268815
Median Absolute Deviation (MAD)	0.014338235
Skewness	8.7739699
Sum	187.84511
Variance	0.018084183
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.3333333333	21	0.7%
0.1666666667	21	0.7%
0.02777777778	20	0.7%
0.09090909091	19	0.6%
0.0625	17	0.6%
0.4	16	0.5%
0.1333333333	16	0.5%
0.03571428571	15	0.5%
0.02380952381	15	0.5%
0.25	15	0.5%
Other values (1339)	2794	94.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005494505495	1	< 0.1%
0.005509641873	1	< 0.1%
0.005586592179	2	0.1%
0.005602240896	1	< 0.1%
0.005617977528	2	0.1%
0.00566572238	1	< 0.1%
0.005681818182	2	0.1%
0.005698005698	3	0.1%

Value	Count	Frequency (%)
3	1	< 0.1%
2	1	< 0.1%
1.571428571	1	< 0.1%
1.5	3	0.1%
1	14	0.5%
0.8333333333	1	< 0.1%
0.75	1	< 0.1%
0.6666666667	12	0.4%
0.6487935657	1	< 0.1%
0.6	1	< 0.1%

avg_ticket
Real number (ℝ)

HIGH CORRELATION
SKEWED

Distinct	2966
Distinct (%)	99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	51.893306

Minimum	2.1505882
Maximum	56157.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	2.1505882
5-th percentile	4.9166611
Q1	13.119333
median	17.940811
Q3	24.97963
95-th percentile	90.497
Maximum	56157.5
Range	56155.349
Interquartile range (IQR)	11.860296

Descriptive statistics

Standard deviation	1036.9345
Coefficient of variation (CV)	19.982048
Kurtosis	2890.7065
Mean	51.893306
Median Absolute Deviation (MAD)	5.9641157
Skewness	53.444215
Sum	154071.22
Variance	1075233.2
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
15	2	0.1%
4.162	2	0.1%
14.47833333	2	0.1%
18.15222222	1	< 0.1%
13.92736842	1	< 0.1%
36.24411765	1	< 0.1%
29.78416667	1	< 0.1%
22.8792623	1	< 0.1%
20.51104167	1	< 0.1%
149.025	1	< 0.1%
Other values (2956)	2956	99.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2.150588235	1	< 0.1%
2.4325	1	< 0.1%
2.462371134	1	< 0.1%
2.511241379	1	< 0.1%
2.515333333	1	< 0.1%
2.65	1	< 0.1%
2.656931818	1	< 0.1%
2.707598253	1	< 0.1%
2.760621572	1	< 0.1%
2.770464191	1	< 0.1%

Value	Count	Frequency (%)
56157.5	1	< 0.1%
4453.43	1	< 0.1%
3202.92	1	< 0.1%
1687.2	1	< 0.1%
952.9875	1	< 0.1%
872.13	1	< 0.1%
841.0214493	1	< 0.1%
651.1683333	1	< 0.1%
640	1	< 0.1%
624.4	1	< 0.1%

avg_rec_days
Real number (ℝ)

Distinct	1258
Distinct (%)	42.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	67.35143

Minimum	1
Maximum	366
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	8
Q1	25.928571
median	48.285714
Q3	85.333333
95-th percentile	201
Maximum	366
Range	365
Interquartile range (IQR)	59.404762

Descriptive statistics

Standard deviation	63.542829
Coefficient of variation (CV)	0.94345182
Kurtosis	4.8877032
Mean	67.35143
Median Absolute Deviation (MAD)	26.285714
Skewness	2.062909
Sum	199966.4
Variance	4037.6912
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
14	25	0.8%
4	22	0.7%
70	21	0.7%
7	20	0.7%
35	19	0.6%
49	18	0.6%
21	17	0.6%
46	17	0.6%
11	17	0.6%
1	16	0.5%
Other values (1248)	2777	93.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	16	0.5%
1.5	1	< 0.1%
2	13	0.4%
2.5	1	< 0.1%
2.601398601	1	< 0.1%
3	15	0.5%
3.321428571	1	< 0.1%
3.330357143	1	< 0.1%
3.5	2	0.1%
4	22	0.7%

Value	Count	Frequency (%)
366	1	< 0.1%
365	1	< 0.1%
363	1	< 0.1%
362	1	< 0.1%
357	2	0.1%
356	1	< 0.1%
355	2	0.1%
352	1	< 0.1%
351	2	0.1%
350	3	0.1%

qtde_returns
Real number (ℝ)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	173
Distinct (%)	5.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	52.255978

Minimum	0
Maximum	80995
Zeros	1481
Zeros (%)	49.9%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	6
95-th percentile	63
Maximum	80995
Range	80995
Interquartile range (IQR)	6

Descriptive statistics

Standard deviation	1503.4837
Coefficient of variation (CV)	28.771515
Kurtosis	2833.6407
Mean	52.255978
Median Absolute Deviation (MAD)	1
Skewness	52.702902
Sum	155148
Variance	2260463.1
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1481	49.9%
1	295	9.9%
3	169	5.7%
6	93	3.1%
2	87	2.9%
4	71	2.4%
5	43	1.4%
12	43	1.4%
8	40	1.3%
7	38	1.3%
Other values (163)	609	20.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1481	49.9%
1	295	9.9%
2	87	2.9%
3	169	5.7%
4	71	2.4%
5	43	1.4%
6	93	3.1%
7	38	1.3%
8	40	1.3%
9	36	1.2%

Value	Count	Frequency (%)
80995	1	< 0.1%
9014	1	< 0.1%
4824	1	< 0.1%
4027	1	< 0.1%
2302	2	0.1%
1776	1	< 0.1%
1608	1	< 0.1%
1589	1	< 0.1%
1515	1	< 0.1%
1278	1	< 0.1%

Auto

The auto setting is an interpretable pairwise column metric of the following mapping:

Variable_type-Variable_type : Method, Range
Categorical-Categorical : Cramer's V, [0,1]
Numerical-Categorical : Cramer's V, [0,1] (using a discretized numerical column)
Numerical-Numerical : Spearman's ρ, [-1,1]

The number of bins used in the discretization for the Numerical-Categorical column pair can be changed using config.correlations["auto"].n_bins. The number of bins affects the granularity of the association you wish to measure.

This configuration uses the recommended metric for each pair of columns.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	customer_id	gross_revenue	recency_days	qtde_invoice	qtde_items	qtde_products	avg_basket_size	avg_unique_basket_size	freq	avg_ticket	avg_rec_days	qtde_returns
0	17850.0	5391.21	372.0	34.0	1733.0	297.0	50.970588	8.735294	0.486111	18.152222	35.500000	21.0
1	13047.0	3232.59	56.0	9.0	1390.0	171.0	154.444444	19.000000	0.048780	18.904035	27.250000	6.0
2	12583.0	6705.38	2.0	15.0	5028.0	232.0	335.200000	15.466667	0.045699	28.902500	23.187500	50.0
3	13748.0	948.25	95.0	5.0	439.0	28.0	87.800000	5.600000	0.017921	33.866071	92.666667	0.0
4	15100.0	876.00	333.0	3.0	80.0	3.0	26.666667	1.000000	0.136364	292.000000	8.600000	22.0
5	15291.0	4623.30	25.0	14.0	2102.0	102.0	150.142857	7.285714	0.054441	45.326471	23.200000	27.0
6	14688.0	5630.87	7.0	21.0	3621.0	327.0	172.428571	15.571429	0.073569	17.219786	18.300000	281.0
7	17809.0	5411.91	16.0	12.0	2057.0	61.0	171.416667	5.083333	0.039106	88.719836	35.700000	41.0
8	15311.0	60767.90	0.0	91.0	38194.0	2379.0	419.714286	26.142857	0.315508	25.543464	4.144444	231.0
9	16098.0	2005.63	87.0	7.0	613.0	67.0	87.571429	9.571429	0.024390	29.934776	47.666667	0.0

	customer_id	gross_revenue	recency_days	qtde_invoice	qtde_items	qtde_products	avg_basket_size	avg_unique_basket_size	freq	avg_ticket	avg_rec_days	qtde_returns
5627	17727.0	1060.25	15.0	1.0	645.0	66.0	645.000000	66.0	0.285714	16.064394	6.0	6.0
5637	17232.0	421.52	2.0	2.0	203.0	36.0	101.500000	18.0	0.153846	11.708889	12.0	0.0
5638	17468.0	137.00	10.0	2.0	116.0	5.0	58.000000	2.5	0.400000	27.400000	4.0	0.0
5649	13596.0	697.04	5.0	2.0	406.0	166.0	203.000000	83.0	0.250000	4.199036	7.0	0.0
5655	14893.0	1237.85	9.0	2.0	799.0	73.0	399.500000	36.5	0.666667	16.956849	2.0	0.0
5659	12479.0	473.20	11.0	1.0	382.0	30.0	382.000000	30.0	0.333333	15.773333	4.0	34.0
5680	14126.0	706.13	7.0	3.0	508.0	15.0	169.333333	5.0	1.000000	47.075333	3.0	50.0
5686	13521.0	1092.39	1.0	3.0	733.0	435.0	244.333333	145.0	0.300000	2.511241	4.5	0.0
5696	15060.0	301.84	8.0	4.0	262.0	120.0	65.500000	30.0	2.000000	2.515333	1.0	0.0
5715	12558.0	269.96	7.0	1.0	196.0	11.0	196.000000	11.0	0.285714	24.541818	6.0	102.0

Overview

Variables

Interactions

Correlations

Auto

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample